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Amendments to the Claims 

This listing of claims will replace all prior versions and listings of claims in the 
application. 

Listing of Claims 

1. (Currently Amended) A computerized method of image analysis comprising: 

a) receiving first image data for a plurality of first video frames representing a first scene, 
wherein (i) each first video frame comprises a plurality of image regions and (ii) a first object is 
present in an image region of at least one first video frame; 

b) receiving second image data for a plurality of second video frames representing a 
second scene, wherein (i) each second video frame comprises a plurality of image regions and (ii) 
a second object is present in an image region of at least one second video frame; and 

c) determining (i) a relationship between first and second image regions of the plurality of 
image regions of the first and second video frames based on a probabilistic correlation between 
occurrences of the first object being present in the first image region and occurrences of the 
second object being present in the second image region and (ii) a lift associated with the first 
object being present in the first image region and the second object being present in the second 
image region . 

2. (Original) The method of claim 1 wherein step c) further comprises c-1) determining a 
conditional probability that the first object is present in the first image region given that the 
second object is present in the second image region. 

3. (Original) The method of claim 1 wherein step c) further comprises c-1) determining a joint 
probability that the first object is present in the first object region and that the second object is 
present in the second image region. 

4. (Cancelled) 
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5. (Original) The method of claim 1 wherein step c) further comprises c-1) determining a 
correlation coefficient associated with the first object being present in the first image region and 
the second object being present in the second image region. 

6. (Original) The method of claim 1 wherein the first image data originates from a first camera 
having a first field-of-view, and the second image data originates from a second camera having a 
second field-of-view. 

7. (Original) The method of claim 6 wherein the first field-of-view and the second field-of-view 
at least in part overlap. 

8. (Original) The method of claim 6 wherein the first field-of-view and the second field-of-view 
do not overlap. 

9. (Original) The method of claim 1 wherein the first image region is one of the image regions 
that comprises the first video frames and the second image region is one of the image regions that 
comprises the second video frames. 

10. (Original) The method of claim 1 wherein the first image region and the second image 
region are both image regions that comprise one of the first video frames and the second video 
frames. 

1 1 . (Original) The method of claim 1 wherein the first object and the second object are the same 
object. 

12. (Original) The method of claim 1 wherein the first object and the second object are different 
objects. 



LIBC/3028128.1 



Amendment and Response 

U.S. Serial No. 10/660,955 
Page 4 of 14 

13. (Original) The method of claim 1 wherein step c) comprises determining a temporal 
relationship between occurrences of the presence of the first object in the first image region and 
occurrences of the presence of the second object in the second image region. 

14. (Original) The method of claim 1 wherein step c) comprises determining a spatial 
relationship between the first image region and the second image region. 

15. (Original) The method of claim 1 further comprising d) counting the number of occurrences 
of any object being present in the first and second image regions. 

16. (Original) The method of claim 1 further comprising d) counting the number of occurrences 
of any object being concurrently present in both the first and second image regions. 

17. (Original) The method of claim 1 further comprising d) counting, for each of a 
predetermined number of earlier time instants, the number of occurrences of both any object 
being currently present in the first image region and any object being present in the second image 
region at the earlier time instants. 

18. (Cancelled) 

19. (Cancelled) 

20. (Currently Amended) The method of claim [[18]] 56 wherein step d) further comprises 
further comprising e) counting, for each of the plurality of attributes, the number of occurrences 
of one of the first and second [[an]] objects with each attribute being present in the first image 
region concurrently with one of the first and second [[an]] objects having each attribute being 
present in second image regions. 

21 . (Currently Amended) The method of claim [[18]] 56 wherein step d) further comprises 
furth e r comprising e ) counting, for each of a predetermined number of earlier time instants, and 
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for each of the plurality of attributes, the number of occurrences of both any one of the first and 
second objects having such attribute being currently present in the first image region and any one 
of the first and second objects having each attribute being present in the second image region at 
the earlier time instants. 

22. (Original) The method of claim 1 further comprising d) correlating the first object in the 
first video frames with a second object present in the second video frames based on the 
determined relationship. 

23. (Cancelled) 

24. (Cancelled) 

25. (Currently Amended) The method of claim [[24]] 58 further comprising d) maintaining an 
object list identifying at least the locations of the first object and the second object. 

26. (Original) The method of claim 25 further comprising: 

e) selecting an object present in one of the first and second video frames; 

f) determining whether the selected object is one of the first object, the second object, and 
a third object based at least in part on the object list and the determined relationship. 

27. (Currently Amended) A surveillance system comprising: 

a) a first memory module for receiving first image data for a plurality of first video 
frames representing a first scene, wherein (i) each first video frame comprises a plurality of 
image regions and (ii) a first object is present in an image region of at least one first video frame; 

b) a second memory module for receiving second image data for a plurality of second 
video frames representing a second scene, wherein (i) each second video frame comprises a 
plurality of image regions and (ii) a second object is present in an image region of at least one 
second video frame; and 

c) a processing module for determining (i) a relationship between first and second image 
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regions of the plurality of image regions of the first and second video frames based on a 
probabilistic correlation between occurrences of the first object being present in the first image 
region and occurrences of the second object being present in the second image region and (ii) a 
lift associated with the first object being present in the first image region and the second object 
being present in the second image region . 

28. (Original) The surveillance system of claim 27 wherein the processing module further 
determines a conditional probability that the first object is present in the first image region given 
that the second object is present in the second image region. 

29. (Original) The surveillance system of claim 27 wherein the processing module further 
determines a joint probability that the first object is present in the first object region and that the 
second object is present in the second image region. 

30. (Cancelled) 

3 1 . (Original) The surveillance system of claim 27 wherein the processing module further 
determines a correlation coefficient associated with the first object being present in the first 
image region and the second object being present in the second image region. 

32. (Original) The surveillance system of claim 27 wherein the first image data originates from 
a first camera having a first field-of-view, and the second image data originates from a second 
camera having a second field-of-view. 

33. (Original) The surveillance system of claim 32 wherein the first field-of-view and the 
second field-of-view at least in part overlap. 

34. (Original) The surveillance system of claim 32 wherein the first field-of-view and the 
second field-of-view do not overlap. 
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35. (Original) The surveillance system of claim 27 wherein the first image region is one of the 
image regions that comprises the first video frames and the second image region is one of the 
image regions that comprises the second video frames. 

36. (Original) The surveillance system of claim 27 wherein the first image region and the 
second image region are both image regions that comprise one of the first video frames and the 
second video frames. 

37. (Original) The surveillance system of claim 27 wherein the first object and the second object 
are the same object. 

38. (Original) The surveillance system of claim 27 wherein the first object and the second object 
are different objects. 

39. (Original) The surveillance system of claim 27 wherein the processing module determines a 
temporal relationship between occurrences of the presence of the first object in the first image 
region and occurrences of the presence of the second object in the second image region. 

40. (Original) The surveillance system of claim 27 wherein the processing module determines a 
spatial relationship between the first image region and the second image region. 

41 . (Original) The surveillance system of claim 27 wherein the processing module further 
counts the number of occurrences of any object being present in the first and second image 
regions. 

42. (Original) The surveillance system of claim 27 wherein the processing module further 
counts the number of occurrences of any object being concurrently present in both the first and 
second image regions. 
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43. (Original) The surveillance system of claim 27 wherein the processing module further 
counts, for each of a predetermined number of earlier time instants, the number of occurrences of 
both any object being currently present in the first image region and any object being present in 
the second image region at the earlier time instants. 

44. (Cancelled) 

45. (Cancelled) 

46. (Currently Amended) The surveillance system of claim [[44]] 59 wherein the processing 
module further counts, for each of the plurality of attributes, the number of occurrences of one of 
the first and second [[an]] objects with each attribute being present in the first image region 
concurrently with one of the first and second r[an]] objects having each attribute being present in 
second image regions. 

47. (Currently Amended) The surveillance system of claim [[44]] 59 further wherein the 
processing module further counts, for each of a predetermined number of earlier time instants, 
and for each of the plurality of attributes, the number of occurrences of both any one of the first 
and second [[an]] objects having such attribute being currently present in the first image region 
and any one of the first and second [[an]] objects having each attribute being present in the 
second image region at the earlier time instants. 

48. (Original) The surveillance system of claim 27 wherein the processing module further 
correlates the first object in the first video frames with a second object present in the second 
video frames based on the determined relationship. 

49. (Cancelled) 

50. (Cancelled) 
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51 . (Currently Amended) The surveillance system of claim [[50]] 61 wherein the processing 
module further maintains an object list identifying at least the locations of the first object and the 
second object. 

52. (Original) The surveillance system of claim 51 wherein the processing module further 
selects an object present in one of the first and second video frames and determines whether the 
selected object is one of the first object, the second object, and a third object based at least in part 
on the object list and the determined relationship. 

53. (Cancelled) 

54. (Cancelled) 

55. (Cancelled) 

56. (New) A computerized method of image analysis comprising: 

a) receiving first image data for a plurality of first video frames representing a first scene, 
wherein (i) each first video frame comprises a plurality of image regions and (ii) a first object is 
present in an image region of at least one first video frame; 

b) receiving second image data for a plurality of second video frames representing a 
second scene, wherein (i) each second video frame comprises a plurality of image regions and (ii) 
a second object is present in an image region of at least one second video frame; 

c) providing a plurality of attributes for the first and second objects; 

d) counting for each of the plurality of attributes, the number of occurrences of at least 
one of the first and second objects having such attribute being present in the first and second 
image regions; and 

e) determining a relationship between first and second image regions of the plurality of 
image regions of the first and second video frames based on a probabilistic correlation between 
occurrences of the first object being present in the first image region and occurrences of the 
second object being present in the second image region. 



LIBC/3028128.1 



U.S. Serial No. 10/660,955 
Page 10 of 14 



Amendment and Response 



57. (New) A computerized method of image analysis comprising: 

a) receiving first image data for a plurality of first video frames representing a first scene, 
wherein (i) each first video frame comprises a plurality of image regions and (ii) a first object is 
present in an image region of at least one first video frame; 

b) receiving second image data for a plurality of second video frames representing a 
second scene, wherein (i) each second video frame comprises a plurality of image regions and (ii) 
a second object is present in an image region of at least one second video frame; 

c) determining a relationship between first and second image regions of the plurality of 
image regions of the first and second video frames based on a probabilistic correlation between 
occurrences of the first object being present in the first image region and occurrences of the 
second object being present in the second image region. 

d) determining that the first object present in one first video frame was not present in a 
preceding first video frame; and 

e) correlating the first object with the second object present in the second video frames 
based on the determined relationship. 

58. (New) A computerized method of image analysis comprising: 

a) receiving first image data for a plurality of first video frames representing a first scene, 
wherein (i) each first video frame comprises a plurality of image regions and (ii) a first object is 
present in an image region of at least one first video frame; 

b) receiving second image data for a plurality of second video frames representing a 
second scene, wherein (i) each second video frame comprises a plurality of image regions 
wherein each image region has a location in one of the plurality of first and second video frames 
that is substantially the same across the plurality of first and second video frames and (ii) a 
second object is present in an image region of at least one second video frame; and 

c) determining a relationship between first and second image regions of the plurality of 
image regions of the first and second video frames based on a probabilistic correlation between 
occurrences of the first object being present in the first image region and occurrences of the 
second object being present in the second image region. 
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59. (New) A surveillance system comprising: 

a) a first memory module for receiving first image data for a plurality of first video 
frames representing a first scene, wherein (i) each first video frame comprises a plurality of 
image regions and (ii) a first object is present in an image region of at least one first video frame; 

b) a second memory module for receiving second image data for a plurality of second 
video frames representing a second scene, wherein (i) each second video frame comprises a 
plurality of image regions and (ii) a second object is present in an image region of at least one 
second video frame; and 

c) a processing module for (i) providing a plurality of attributes for objects, (ii) counting 
for each of the plurality of attributes, the number of occurrences of an object having such 
attribute being present in the first and second image regions, and (iii) determining a relationship 
between first and second image regions of the plurality of image regions of the first and second 
video frames based on a probabilistic correlation between occurrences of the first object being 
present in the first image region and occurrences of the second object being present in the second 
image region. 

60. (New) A surveillance system comprising: 

a) a first memory module for receiving first image data for a plurality of first video 
frames representing a first scene, wherein (i) each first video frame comprises a plurality of 
image regions and (ii) a first object is present in an image region of at least one first video frame; 

b) a second memory module for receiving second image data for a plurality of second 
video frames representing a second scene, wherein (i) each second video frame comprises a 
plurality of image regions and (ii) a second object is present in an image region of at least one 
second video frame; and 

c) a processing module for (i) determining a relationship between first and second image 
regions of the plurality of image regions of the first and second video frames based on a 
probabilistic correlation between occurrences of the first object being present in the first image 
region and occurrences of the second object being present in the second image region, (ii) 
determining that the first object present in one first video frame was not present in a preceding 
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first video frame and (iii) correlating the first object with the second object present in the second 
video frames based on the determined relationship. 

61. (New) A surveillance system comprising: 

a) a first memory module for receiving first image data for a plurality of first video 
frames representing a first scene, wherein (i) each first video frame comprises a plurality of 
image regions and (ii) a first object is present in an image region of at least one first video frame; 

b) a second memory module for receiving second image data for a plurality of second 
video frames representing a second scene, wherein (i) each second video frame comprises a 
plurality of image regions, wherein each image region has a location in one of the plurality of 
first and second video frames that is substantially the same across the plurality of first and second 
video frames, and (ii) a second object is present in an image region of at least one second video 
frame; and 

c) a processing module for determining a relationship between first and second image 
regions of the plurality of image regions of the first and second video frames based on a 
probabilistic correlation between occurrences of the first object being present in the first image 
region and occurrences of the second object being present in the second image region. 
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